Skip to content

feat(ai): Build LLM cache shadow reports - #127024

Merged
vgrozdanic merged 2 commits into
feat/llm-cache-pricingfrom
feat/llm-cache-reporting
Oct 13, 2026
Merged

vgrozdanic merged 2 commits into
feat/llm-cache-pricingfrom
feat/llm-cache-reporting

Conversation

@vgrozdanic

@vgrozdanic vgrozdanic commented Oct 9, 2026 •

Copy link
Copy Markdown
Member

Defines the reviewer-facing shadow report for each LLM prompt-cache candidate.

Each report preserves both provisional and validated classifications, severity rank, simulated issue disposition, cache evidence, pricing result, and any reason an enrichment step could not produce data. It also includes derived token signals and the fixed prompt-size threshold used during classification, making detector decisions explainable from one structured record.

For candidates that would become issues, the detector can sample up to three large calls from distinct traces. Samples contain only trace ID, span ID, timestamp, and token counts. They never fetch or record prompt content.

validated finding
+ savings estimate
+ trace references
→ structured candidate fields
→ shadow log emission in next stack layer

This layer builds report data but does not emit logs, schedule scans, or create issues.

@vgrozdanic
vgrozdanic added this pull request to stack #127016 October 9, 2026 12:28
@github-actions github-actions Bot added the Scope: Backend Automatically applied to PRs that change backend components label Oct 9, 2026
@vgrozdanic
vgrozdanic force-pushed the feat/llm-cache-reporting branch from 0bf0409 to 2d752ed Compare October 12, 2026 12:45
@sentry

sentry Bot commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Sentry Snapshot Testing

Name Added Removed Changed Renamed Unchanged Skipped Status
sentry-frontend
sentry-frontend
0 0 0 0 620 0 ✅ Unchanged

⚙️ sentry-frontend Snapshot Settings

@vgrozdanic
vgrozdanic force-pushed the feat/llm-cache-reporting branch 3 times, most recently from 6b2b1f5 to 0b2c696 Compare October 13, 2026 05:17
@vgrozdanic
vgrozdanic marked this pull request as ready for review October 13, 2026 05:28
@vgrozdanic
vgrozdanic requested a review from a team as a code owner October 13, 2026 05:28
@vgrozdanic
vgrozdanic force-pushed the feat/llm-cache-reporting branch from 0b2c696 to a0b447b Compare October 13, 2026 07:16
@vgrozdanic
vgrozdanic merged commit 8ed8b2a into master Oct 13, 2026
66 checks passed
@vgrozdanic
vgrozdanic deleted the feat/llm-cache-reporting branch October 13, 2026 08:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Scope: Backend Automatically applied to PRs that change backend components

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants